WO 2004/038603 



1 



PCT/FR2003/003115 



IMPROVED HANDWRITTEN-DATA-PROCESSING DEVICE AND 
INSTALLATION WHICH PROVIDE A CERTIFIED DATA BACK-UP WITH 
LINKS 

The invention relates to the saving and archiving of handwritten information, in 
electronic form and in real time. 

A number of solutions have been proposed to enable a person to save, in electronic form 
and in real time, information that he or she has transcribed onto a writing medium. 
These solutions include in particular graphic tablets and electronic pens. 

A graphic tablet generally includes a sensitive surface intended to receive a writing 
medium, such as a sheet of paper, and coupled to means of recognising data or 
handwritten information. 

An electronic pen is a device equipped with a writing stylus and means capable of 
capturing data or information written with the stylus by analysing its micro-movements 
on a writing medium. The latter makes it possible, when provided with pre-defined 
irregular reference marks or when coupled to an electromagnetic detection device, to 
determine the location where the information has been written. Such a pen is proposed 
in particular by the company Anoto. 

In either case, the handwritten data is "captured" then saved in digital form, in 
correspondence with its respective positions, in an electronic file which can then be read 
by an IT device, such as a computer, so that the data can be displayed on a screen. 

Certain data-processing applications allow a document containing digitized handwritten 
information to be annotated by hand. However, once said document has been annotated, 
it is generally no longer possible to differentiate the initial information from the 
information added subsequently and possibly at different times. This can be a source of 
dispute when the digitized document is used as evidence in court proceedings seeking to 
determine, for example, the true creator of an idea or an invention. There is therefore a 
real need for certification of the dates of data entries into a document that are spread 
over a period of time. 
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Moreover, by reason of the ever growing number of documents and information 
sources, it is becoming indispensable to establish durable links (or bridges), for example 
of the hypertext type (or on-line link) between information belonging to handwritten 
documents and other documents, handwritten or otherwise, and/or sources of public 
5 and/or private information. 

There is also a serious need for indexing of documents or portions of digitized 
handwritten documents, in particular to facilitate accurate archiving or efficient 
searches. 

Furthermore, there is a real need for portability of certain digitized handwritten 
10 documents so that handwritten annotations or additions can be made thereto at any 
location, such as a laboratory for example. 

The aim of the invention is therefore to remedy all or some of the aforementioned 
drawbacks and/or needs. 

To this end it proposes a data-processing installation including in combination: 

15 - a writing medium defining at least one zone enabling a user to enter handwritten 
primary data such as letters or numbers for example; 

- means of recognition to capture the primary data entered in the zone; 

- a display enabling data, in particular primary data, to be displayed; 

- means of interaction enabling a user i) to associate processing operators and/or 
20 secondary data, such as for example handwritten or non-handwritten characters, images, 

references, links (or addresses) or identifiers, with primary data entered in the zone, and 
ii) to activate primary data entered or associated secondary data when they designate 
external data stored in at least one database; 

- processing means arranged i) to associate a timestamp representing the time of data 
25 entry or association, and an identifier representing the zone, with the processing 

operators and/or with the primary or secondary data, and ii) in the case where a user 
activates primary or secondary data, to access the database in which the external data 
designated by the activated data is stored, such that this external data is displayed by the 
display device. 
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Thus, handwritten information entered by a user on a writing medium (such as for 
example an electronic notebook (a notebook with "pages" allowing electronic data input 
using a dedicated pen), a graphic tablet or a handwriting recognition screen) can be 
saved in real time, in a memory, in correspondence with a timestamp and an entry zone 
identifier, and can be subject at a later time to handwritten annotations or additions of 
any kind, and in particular processing operators, also saved in correspondence with a 
timestamp and/or processing using operators, for example bracketing, underscoring or 
font change. In addition, when digitized entered information is linked to other internal 
or external information, the user can access the latter in real time by activating the 
entered information. 

It is important to note that the invention relates more particularly to the capture of the 
trace of handwritten characters and not the image of such characters. Therefore, the 
invention does not require, a priori, character recognition of the OCR type for example. 
It only requires recording of the traces left by the handwritten characters. 

Preferably, the processing means are arranged so as to associate primary level and 
secondary level identifiers with the primary and secondary data in a zone. Furthermore, 
when the writing medium is of the electronic type, it can be arranged so as to deliver to 
the processing means tertiary data representing an input mask of the zone. In this case, 
the processing means are arranged to associate tertiary level identifiers with the tertiary 
data in a zone before storing it in the memory. In this way, the zone and its data can be 
broken down into levels (or layers), such as for example a preprinted layer (tertiary 
level), an initial handwritten information layer (primary level) and an annotation and 
addition layer (secondary level). 

The installation according to the invention can include numerous additional 
characteristics which can be taken separately and/or in combination, and in particular: 

- recognition means which ca n i nclude a pen arranged to enable a user to enter primary 
and/or secondary data via the writing medium, and to capture the primary and/or 
secondary data thus entered in order to communicate it to the processing means; 

- recognition means which can include a pen arranged to enable a user to enter primary 
and/or secondary data via the writing medium, in order to capture the primary and/or 
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secondary data thus entered in cooperation with the recognition means, and then to 
communicate it to processing means; 

- recognition means which can include a graphic tablet to accommodate the writing 
medium and to capture the primary and secondary data entered on the writing medium, 

5 then to communicate it to the processing means; 

- a writing medium provided in the form of an electronic notebook defining a 
multiplicity of input zones for primary and/or secondary data, such as pages for 
example; 

- at least one computer connected to the recognition means and including the display 
10 and at least one part of the processing means, and possibly also at least one part of the 

interaction means; 

- at least one computer including the display, the recognition means, and at least one 
part of the processing means, and possibly also at least one part of the interaction 
means. In this case, it is particularly advantageous that the display screen constitutes the 

15 writing medium; 

- at least one Personal Digital Assistant (PDA) incorporating an auxiliary display 
arranged to facilitate the entry of secondary data by a user, at least one part of the 
interaction means, at least one part of the processing means, and a part of the 
recognition means, so as to capture the secondary data entered via the auxiliary display. 

20 Each PDA can be also equipped with tracking means connected to the recognition 
means and capable of determining the positioning of the auxiliary display screen of the 
PDA relative to the input surface, so that the part of the zone displayed on the PDA 
screen substantially matches the portion of the zone of the writing medium located 
under the PDA; 

25 - a^eomputer connect e d to the Internet and/or to at least one private database (internal or 
external). 

The invention also relates to a data processing device including processing means 
arranged so as to: 
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- address instructions to a display requiring the display of at least one part of 
handwritten primary data captured by recognition means following entry by a user in 
one zone of a writing medium; 

- associate a timestamp representing the time of data entry or association and an 
identifier representing the zone, with the primary data, and with processing operators 
and/or secondary data, associated by interaction means with at least some of the primary 
data displayed by the display device, and 

- in case of activation by the interaction means, at the user's command, of primary or 
secondary data designating external data stored in a database, to access this database so 
that the external data is displayed by the display device. 

Such a device can advantageously equip an installation of the type described above. 

Other characteristics and advantages of the invention will become apparent upon 
examination of the following detailed description together with the attached drawings in 
which: 

- Fig. 1 is a schematic illustration of part of an installation according to the invention 
including computers linked to external recognition means; 

- Fig. 2 is a schematic illustration of an example of the breakdown of a page into a 
multi-layered structure; 

- Fig. 3 is a schematic illustration of a variant of a computer including integral 
recognition means, and capable of being used in the installation according to the 
invention; 

- Fig. 4 details the graphic tablet of the installation in Fig. 1 , linked to a personal digital 
assistant equipped with a tracking module, and 

- Fig. 5 is a schematic illustration of an example of data processing performed by means 
of a personal digital assistant forming part of the installation. 

The attached drawings will not only serve to assist understanding of the invention, but 
will also contribute to its definition, as the case may be. 
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The invention proposes an installation and a device that make it possible in particular to 
capture information entered by users by means of data-processing equipment, to save 
this information in the form of digital data, also termed "on-line" data, in 
correspondence with a timestamp, to display this digital data in response to dedicated 
commands, and to establish links (or bridges) between the on-line digital data and so- 
called "off-line" or "physical" data stored in public or private databases. 

To achieve this purpose, and as illustrated in Fig. 1, the installation according to the 
invention includes at least: 

- one computer 1, including at least one central processing unit 2; 

- a writing medium 3 defining one or more zones 4 enabling a user to enter data or 
handwritten primary characters, such as for example letters, numbers, diagrams or 
drawings; 

- a recognition module 5 capable of recognising the data or primary characters entered 
in one of the zones 4; 

- a main display 6 capable of displaying at least part of the data or primary characters 
entered, such as for example a monitor or screen of a personal digital assistant (more 
generally known by the acronym PDA); 

- an interaction module 8 arranged so as to enable a user to associate processing 
operators and/or secondary data, such as handwritten or non-handwritten characters, 
images, references, links (or addresses) or identifiers, with at least some of the primary 
data displayed by the display device 6, and to activate primary or secondary data when 
they designate external data stored in at least one database 9; 

- a processing module 10 arranged so as to associate with the processing operators and 
with the primary or secondary data a timestamp representing the time of entry or 
association thereof and an identifier representing their assigned zone 4, and in the case 
of activation of primary or secondary data by a user, to access the database 9 in which 
the external data designated by the activated data is stored, such that this external data is 
displayed by the display device 6. 

In the first embodiment illustrated in Fig. 1, the display device 6, termed the "main" 
display, forms part of the computer 1 . It takes the form of a monitor having a so-called 
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main screen 7 enabling a zone 4 of the writing medium 3 to be displayed. Furthermore, 
in this example the recognition module 5 takes the form of a graphic tablet arranged so 
as to accommodate the writing medium 3 for the entry of primary characters. This 
graphic tablet 5 is connected to the central processing unit 2 of the computer 1 by means 
5 of a hard- wired link or wireless link, for example via an infrared or Bluetooth interface. 

The use of any graphic tablet 5 can be envisaged provided that it is capable of capturing 
the characters entered by the user via the writing medium 3 placed on its receiving 
surface. For example, it can function by pressure detection and by electromagnetic 
analysis, as in the particular case of the Intuos model made by the company WACOM. 

10 Furthermore, the type of writing medium 3 depends on the type of recognition module 
5. It can consist of one or more sheets of paper enabling the user to write with a 
conventional pen, for example an ink pen, or one or more electronic sheets linked to an 
electronic pen. 

In the example illustrated, the writing medium 3 is a laboratory notebook including a 
15 multiplicity of sheets defining pages 12 delineating zones 4 for the entry of handwritten 
or non-handwritten characters. 

Of course, other types of recognition module can be envisaged. Thus it is possible to 
employ a graphic tablet using certain electronic pens, such as for example those 
proposed by the company Anoto, linked to sheets having predefined irregular reference 
20 marks enabling the styluses of said pens to determine their positions relative to said 
sheets. Such an electronic pen is provided with recognition means which enable it to 
recognise written characters by analysing its micro-movements. In addition it is 
equipped with a wireless interface which enables it to transfer the primary data, 
generated by the conversion of the characters entered, to the central processing unit 2. 

25 In the example illustrated in Fig. 1, the processing module 10 is installed in the central 
processing unit 2 of the computer 1. It receives the primary data delivered by the 
recognition module, in this instance the graphic tablet 5, and on receiving the user's 
command, it transmits the data to the main display 6 so that it is displayed on main 
screen 7, or as a variant it transmits it to the PDA. 

30 As illustrated, the installation can include a multiplicity of computers 1 networked 
together, of the Intranet type for example. In this case, each computer 1 is preferably 
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connected to a recognition module 5, for example a graphic tablet, and to a server 11, 
for example linked to a private database 9 and preferably to the Internet, possibly via a 
firewall. Of course, however, each computer 1 could be directly connected to the 
Internet to facilitate access to remote information sources, whether private or public. 

In the example illustrated, the interaction module 8 is installed, at least partially, in the 
central processing unit 2 of the computer 1. It enables the user to associate secondary 
data (annotations) and/or processing operators with the primary data, via the writing 
medium 3. It can also possibly be used in conjunction with an electronic or analogue 
pen, enabling the user to activate dedicated commands or certain information in the 
document displayed on the main screen 7 and/or to annotate the document. Of course, 
the display 6 (or the PDA) must be adapted for this purpose. It may for example be 
equipped with an interactive screen of the same type as those used in personal digital 
assistants (PDA) or LCD tablets. To this end, it can for example use the Cintiq 18X 
tablet screen made by the company WACOM. 

15 The operation of the installation presented above will now be described in detail. After 
switching on the computer 1 and graphic tablet 5, the user places the writing medium 3, 
in this instance a laboratory notebook, on the graphic tablet 5, then opens the notebook 
at the chosen page 12. Two cases then need to be considered depending on whether or 
not the notebook 3 includes pages 12 having page numbers 13, as illustrated in Fig. 1 . 

20 Where the page numbers 13 are pre-entered, the user must tell the processing module 10 
the number of the page on which he/she wishes to write. To do this, the user either 
activates one of the dedicated commands 14 in a menu offered by the graphic tablet 5, 
or uses a micro-scanner linked to the processing module 10, such as a PocketReader® 
for example, or writes the number in a dedicated input field on the page 12. The user 

25 can then start to write primary data or characters (letters, numbers, drawing lines, and 
the like) in the entry zone 4 of the chosen page. The graphic tablet 5 captures this 
primary data or characters, then converts them into primary digital data which it 
transmits, together with digital position data, to the processing module 10, in this 
instance installed in the computer 1 . When the user has finished entering information, 

30 there is no need to notify the processing module 10 because the transfer and processing 
of the data are performed "on the fly". 
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At this stage, this processing involves associating a timestamp representing the time of 
data entry and an identifier representing the assigned zone, in this instance a page 12 of 
a laboratory notebook 3, with the primary data and corresponding position data. The 
primary data, position data, timestamp and page identifier are stored in the memory 1 5 
5 of the central processing unit 2, in a page-file of a folder previously created and 
corresponding to the user's laboratory notebook 3. The processing module 10 can then 
be configured to transfer automatically, or at the user's command, the updated folder (or 
the page-file only) to the corporate database 9. 

Preferably, the aforementioned storage will be in a multi-layer form, for example based 
10 on the Fekete-Beaudouin-Lafon model extended to take account of external "physical" 
information. In this multi-layer model, illustrated in Fig. 2, a first layer 17, termed the 
"paper layer", can correspond to data pre-printed on the page 12 of the laboratory 
notebook 3, such as for example the header 16, the page numbers 13 and the input 
masks; a second layer 18, termed "ink layer", can correspond to the primary data 19 
15 "inscribed" in the entry zones 4 of the page 12; and a third layer 20, termed "annotation 
layer", can correspond to the secondary data 21 and 22 added to the primary data in the 
ink layer 1 8 after it has been saved for the first time, and to which further reference will 
be made below. 

Preferably, the information (primary data) 19 belonging to the ink layer 18 cannot be 
20 altered, so that a certain indisputable date can be assigned thereto. 

Preferably also, the page-files are stored in an XML type format, and each layer of a 
page-file is represented in an SVG type vector format (described in particular at the 
address "http://www.w3c.org/svg"). Of course, other types of storage format and 
representation format can be envisaged. 

25 When a user wishes to read the information contained in his/her laboratory notebook, 
he/she either uses— said notebook (as writing medium 3), or uses the application 
controlled by the processing module 10 of the computer 1, which retrieves the 
corresponding folder from the memory 15 or from the database 9 residing on the 
corporate network. The folder is then displayed on the screen 7 of the computer 1 , and 

30 the user can select one of the page-files, via the interaction module 8. The latter then 
addresses instructions (or commands) to the display such that the selected page is 
displayed on the screen 7. 
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In addition, the application controlled by the processing module 1 0 presents the user, on 
the graphic tablet 5, with a menu of dedicated commands 14 controlled by the 
interaction module 8 and enabling him/her to perform various operations. The range of 
possible operations includes in particular: 

5 - addition of secondary elements, such as written characters (letters, numbers, drawing 
lines), references of any kind (scanned or written), addresses or links of any kind 
(possibly imported), in particular internal or external data sources, barcodes (scanned or 
imported as the case may be) designating any type of object or any type of document 
residing on the corporate network, images (scanned or imported as the case may be), 
10 and the like; 

- association of processing operators to primary data. These operators can include in 
particular an operator to bracket data and an operator to underscore data. 

A secondary data item or a processing operator can be written or incorporated using one 
of the dedicated commands 14 managed by the interaction module 8. 

15 The entry may be written directly onto the writing medium 3, or on an additional piece 
of paper, such as a Post-It®. In the latter case, the user places the Post-It® in the desired 
position on the writing medium 3, executes one of the dedicated commands 14 provided 
for this purpose, then enters the secondary characters on the Post-It®, and executes the 
dedicated command 14 once more when finished. 

20 Integration can be performed on a text, an image or a diagram, scanned, directly, or 
imported from an internal (9) or external data source (Internet). In addition, the 
integration can be accompanied by a scaling operation so that the element in question is 
made to fit into a window defined manually by the user on the page 12 of the laboratory 
notebook 3, for example by means of lines defining two diametrically opposing angles. 

25 Th e und e rscor e operator s e rv e s, for e xampl e , to tell the proc e ssing module 10, via th e 
interaction module 8, that the corresponding text is a link or an address (URL for 
example) to an internal or external data source (a site accessible via the Internet for 
example). Thus, when the user activates data defining a link, using one of the dedicated 
commands 14, the processing module 10 instructs the central processing unit 2 to 

30 establish the connection with the data source designated by said link and the information 
contained in this source (for example "web" pages) is imported into the central 
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processing unit then displayed on the screen 7 (or the PDA). The user can then browse 
said information and/or establish links with other sources of information. Of course, to 
activate data defining a link the user can either apply pressure on the data inscribed on 
the writing medium 3 (laboratory notebook), or apply pressure on the data displayed on 
the screen 7 (or the PDA), or select this data with the mouse of the computer 1 . The 
underscore operator can also be used by the user to indicate that certain characters are 
required to undergo a recognition process. 

Preferably, all underscored data, defining links or addresses, are listed in an index in 
correspondence with their respective timestamps and zone identifiers. This index is 
preferably updated regularly. 

The bracketing operator can, for example, serve to tell the processing module 10, via the 
interaction module 8, that the bracketed text is associated with a search identifier, such 
as «PCR» or «RMN» for example. In this way, when a user performs a search on one of 
the identifiers, all the user needs to do is write the chosen identifier on any page of the 
laboratory notebook or in a window of the screen 7 (or PDA), then select the dedicated 
command 14 defining the search function, in order to cause all of the bracketed portions 
in the documents stored in the database 9, and associated with this identifier, to be 
imported then displayed on the screen 7 of the computer 1 . 

Recognition of underscored and bracketed elements by the processing module 10 can be 
based for example on Rubin's algorithm. 

As previously indicated, the secondary data which is inscribed on the writing medium 3, 
in this instance a page 12 of a laboratory notebook 3, or associated with the primary data 
that it contains, is converted into secondary digital data which is transmitted to the 
processing module 10, accompanied by position data. 

When the user has finished annotating the selected page 12, he/she executes a dedicated 
command 14 in the menu proposed by the graphic tablet 5, or a dedicated command in a 
menu of the application managed by the processing module 10 and displayed on the 
screen 7 of the computer 1, to tell the processing module 10 that it can process the 
secondary data received. 

At this stage, the processing involves associating a timestamp representing the time of 
data entry and an identifier representing their assigned zone, in this instance a page 12 



WO 2004/038603 PCT/FR2003/0031 15 

12 

of the laboratory notebook 3, with the secondary data and corresponding position data. 
The secondary data, position data, timestamp and page identifier are stored in the 
memory 15 of the central processing unit 2, in the annotation layer 20 of the page-file of 
the folder corresponding to the user's laboratory notebook 3. The processing module 10 
can then be configured to transfer automatically, or at the user's command, the updated 
folder (or the updated page-file only) to the database 9 residing on the corporate 
network. 

Preferably, the processing module 10 is arranged so as to automatically generate for 
each laboratory notebook (or more generally each document) a table of contents 
containing the associated identifiers links and addresses, so as to facilitate searching or 
browsing within said file. It is important to note that by virtue of the data timestamp and 
associated identifiers, the search can be based not only on one or more identifiers, but 
also on a selected date or period. 

The search function can also be based on a selected portion of text for example by virtue 
of the fact that its font has been modified. 

The commands 14 in the menu can also include a correction function enabling a user to 
select a portion of text that he/she wishes to correct or simply to check. In this case, the 
selected portion is displayed on the screen 7 (or the PDA), preferably after having been 
enlarged. 

Several variants of the embodiment described above can be envisaged. 

In a first variant, the interaction module 8 can be at least partially installed in an 
electronic input screen, of the type proposed by the company Gyricon or by the 
Massachusetts Institute of Technology. Such a screen simultaneously provides for the 
display, the entry zone for handwritten characters, and the recognition of said 
characters. This screen simply needs to be connected, by hard-wired or wireless means 
(for example via an infrared or Bluetooth interface), to a central processing unit 2 
equipped with the processing module 10 according to the invention. 

In a second variant, illustrated in Fig. 3, the interaction module 8 is installed entirely in 
the computer 1. More precisely, the computer 1, which can be of the portable type, 
includes an electronic input screen 7 linked to a recognition module 5 and to an 
interaction module 8 combined with an electronic pen 26. A computer of this kind 
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supporting the recognition of written characters is proposed in particular by the 
company Microsoft under the name Windows XP Tablet PC Edition. Character 
recognition is accomplished for example by means of a grid operating on the 
electromagnetic resonance principle. This type of computer has the advantage of 
5 combining in a single data-processing unit the display, the entry zone for handwritten 
, characters, the recognition of said characters, and the link to internal or external data 
sources. 

In a third variant, the interaction module 8 is at least partially installed in a PDA 23. In 
this case, two embodiments can be envisaged. 

10 A first embodiment of this third variant entails using the PDA 23 as a complement to the 
computer 1 described above, in particular for the purpose of making changes and/or 
additions to the primary data. In this case, advantage is taken of the fact that the PDA 23 
is already equipped from the outset with handwriting recognition means and interaction 
means enabling the user to work with the aid of a dedicated pen 26 on the document 

15 displayed on its screen. The recognition module 5, equipped with the writing medium 3, 
converts the primary characters entered via said medium 3 into primary digital data then 
transmits this data to the part of the processing module 10 installed in the central 
processing unit 2 of the computer 1 to which it is linked. The latter can then transmit all 
or part of the primary data received, or primary and/or secondary data extracted from a 

20 data source, to the part of the processing module 10 installed in the PDA, such that said 
data is displayed on the associated screen 24 where it is possibly subjected to 
modification or addition of secondary data by means of dedicated commands offered by 
the pop-up menu of the associated interaction module 8 and a dedicated pen 26, at any 
location, according to the method described above in reference to Fig. 1. If the 

25 modification or addition is carried out at a distance beyond the range of the 
communications interface of the PDA 23, the corresponding page-file is stored 
temporarily in said PDA, then transferred as soon as said PDA is once again connected 
to the computer 1 , for processing therein. 

Of course, the interaction module 8 of the PDA 23 must be adapted or reconfigured in 
30 order to make the functions described above available to the user. 

Such a PDA can be linked to a computer with integral graphic tablet, of the type 
described above in reference to Fig. 3. 
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A second embodiment of the third variant, illustrated in Figs 4 and 5, entails using the 
display 24 of the PDA 23 as the main display. In this case, the PDA 23 is equipped with 
a part of the processing module 10 (the other part being installed in the computer 1), 
handwriting recognition means and interaction means 8 which, being already present 

5 from the outset, only need to be adapted or reconfigured. It is also linked to the 
recognition module 5, in this instance the graphic tablet, and to the other part of the 
processing module 10, installed in the central processing unit 2 of the computer, in 
particular for the purpose of establishing connections with internal or external data 
sources. The primary characters written by the user on the writing medium 3 are 

10 converted into primary digital data by the recognition module 5, which then transmits 
this data to the part of the processing module 10 installed in the PDA 23. This primary 
data can then be displayed on the screen 24 of the PDA portion by portion if the user so 
wishes. 

The processing module 10 can for example be written in Java, with the exception of the 
15 part providing the interface with the recognition module 5, which is preferably written 
in C. But, of course, any other type of computer language can be used. 

The drawback of this embodiment is that it obliges the user to scroll the text containing 
the received primary data in order to select the part of the text to be worked on. To 
remedy this drawback, the invention makes provision to equip the PDA 23 with a 

20 tracking device 25 intended to determine its position in relation to the writing medium 
3, by exchanging information with the recognition module 5. To do this, it is possible in 
particular to use a graphic tablet such as the Intuos, and a tracking device 25 such as the 
4D mouse, marketed by the company WACOM. This combination of electronic 
elements makes it possible to determine not only the relative position of the PDA 23 in 

25 relation to the writing medium 3, placed on the graphic tablet 5, but also any rotation 
that it undergoes relative to said medium 3. Consequently, the recognition module 5 
addresses to the PDA 23 only the primary data matching the prima ry characters 
inscribed on the portion of the writing medium 3 positioned substantially under it. 

As illustrated in Fig. 4, in case of a difference in orientation between the PDA 23 and 
30 the writing medium 3, the information inscribed on the writing medium 3 is not 
straightened before being displayed on the screen 24, so that the PDA acts as a kind of 
interactive lens (or magnifying glass). 
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The tracking device 25 must be pre-calibrated. Also, the management module 
controlling the tracking device 25 is preferably installed in the PDA 23. It 
communicates with the recognition module 5 and the two parts of the processing 
module 10 for example via a Java Remote Method Invocation application (more 
5 generally known by the acronym JRMI). The Java objects are shared by virtue of being 
stored in an object container in an RMI registry. 

Of course, any other mode of communication can be envisaged. 

Each module can access the shared objects stored in the container by calling them by 
name, regardless of their respective physical locations. The shared objects include the 
database 9 holding the documents (laboratory notebooks) in XML format. When the 
PDA 23 is not sufficiently powerful to transcribe in real time the multi-layer description 
of the pages in SVG format, this operation is performed by the part of the processing 
module 10 installed in the computer 1, for example using the Batik protocol described at 
the address M http://xml.apache.org/batik/ M . Thus, the part of the processing module 10 
installed in the PDA 23 is only then required to handle the images in bitmap format. The 
latter receives updated images from the computer 1 in the form of compressed tiles of 
raster data. Each image is transformed by the computer 1 by means of an affine 
transformation taking into account the current position and orientation of the PDA 23, 
which is notified in the event of a change. 

20 Of course, in this embodiment, the primary and/or secondary data displayed on the 
screen 24 of the PDA 23 can also originate from an external data source (the Internet for 
example) or an internal data source (the database 9 for example), via the part of the 
processing module 10 installed in the central processing unit 2 of the computer 1. 
Therefore, it is also possible to load into the memory of the PDA 23 one or more 

25 documents containing primary and/or secondary data, so that they can, if necessary, 
undergo modification or addition of secondary data and/or processing operators via the 
dedicated commands offered by the pop-up menu of the interaction module 8 and a 
dedicated pen 26, at any location, in accordance with the method described above in 
reference to Fig. 1 . If the modification or addition is performed at a distance beyond the 

30 range of the communications interface of the PDA 23, the corresponding page-file is 
stored temporarily in said PDA, then transferred as soon as said PDA is once again 
connected to the computer 1, to be processed therein. 
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Furthermore, in this second embodiment, it is not essential to connect a monitor 6 to the 
central processing unit 2 of computer 1 , or it can serve as an auxiliary screen intended to 
facilitate reading of the information inscribed on the writing medium 3 and converted 
into primary data by the recognition module 5, and for the display of information 
imported from internal or external data sources linked to the primary data. Where such a 
monitor 6 is provided, it is also possible to equip the computer 1 with an interaction 
module 8. 

It is also possible to provide, among the dedicated commands of the application, a 
correction function enabling a user to select, with the aid of a dedicated pen 26, a 
portion of text 27 that he/she wishes to correct or simply to check. In this case, the 
selected portion 27 is displayed on the screen 24 of the PDA 23, possibly after having 
been enlarged. 

Such a PDA can be connected to a computer with integral graphic tablet, of the type 
described above in reference to Fig. 3. 

The invention has been presented above in the form of an installation. However, it can 
also be presented in the form of a data processing device intended to be installed in a 
centralised or distributed manner in one or more data-processing units of the 
installation, such as for example a computer and/or external recognition module, such as 
a graphic tablet, and/or a PDA. 

This data processing device includes processing means 10 arranged so as to: 

- address instructions to a display device 6, said instructions requiring the display of at 
least one part of handwritten primary data captured by recognition means 5 after being 
entered by a user in a zone 4 of a writing medium 3; 

- associate a timestamp representing the time of data entry or association and an 
identifier representing the zone 4 with the primary data, and with processing operators 
and/or secondary data, associated by interaction means 8 with at least some of the 
primary data displayed by the display 6 device, and 

- access the database, in case of activation by the interaction means 8 (at the user's 
command) of primary or secondary data designating external data stored in at least one 
database 9, such that this external data is displayed by the display device 6. 
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The processing and interaction modules presented above can be implemented in the 
form of electronic circuits, software (or data processing) modules, or a combination of 
circuits and software. Furthermore, the recognition means of the invention can be of any 
type, provided that they are capable of capturing primary data in any form, and in 
5 particular handwritten characters. 

By virtue of the invention, it is possible in particular to capture data written by a user on 
a writing medium, such as a laboratory notebook or input screen, to select some of this 
data in order to assign an identifier thereto enabling it to be readily retrieved and/or to 
associate it with other data, such as for example URL addresses, identifiers designating 
10 internal or external databases, objects or locations residing on a server, or images. 

In addition, it is also possible to display the pages of a document, such as a laboratory 
notebook, stored in a database, or a selected part of a document in response to a user 
command. 

It is also possible to manage links between data captured in a document and data of the 
15 same type within the same document or another document of the same type, or a data 
source associated with said captured data by means of a chosen identifier. 

The invention is therefore suitable for numerous applications, such as for example in the 
field of research (laboratory notebooks used in particular by biologists, pharmacists, 
chemists, and more generally all researchers), or for the management of schedules or 
20 planning charts, or for note-taking during meetings or courses, and has general 
relevance to all applications in which handwritten marks can be used to access on-line 
data, or where the timestamp of the handwritten marks can be used in particular for 
archiving purposes. 



